arXiv:1502.05741v2 [physics.soc-ph] 28 Jan 2016 


Measuring social complexity and the emergence of cooperation from entropic 

principles 

O Lopez-Corona 1 ’ 2,3 *, P Padilla 4 , A Huerta 5 , D Mustri-Trejo 6 , K Perez 2 , A Ruiz 2 , O Valdes 2 and F Zamudio 7 
1 Instituto de Investigation sobre Desarrollo Sustentable y Equidad Social , Universidad Iberoamericana, 
Prolongation Paseo de la Reforma 880, Lomas de Santa Fe, CDMX, Mexico 
2 Centro de Ciencias de la Complejidad, Universidad National Autonoma 
de Mexico Circuito Escolar, Cd. Universitaria, CDMX, Mexico 
3 Former: Catedras CONACyT, Universidad Autonoma Chapingo, 

Carretera Mexico-Texcoco Kilometro 38.5, Estado de Mexico, Mexico 
4 Instituo de Investigation en Matematicas Aplicades y en Sistemas, 

Universidad National Autonoma de Mexico Circuito Escolar, Cd. Universitaria, CDMX, Mexico 
5 Facultad de Ciencias, Universidad National Autonoma de Mexico Circuito Escolar, Cd. Universitaria, CDMX, Mexico 
6 Posgrado en Ciencias Fisicas, Universidad Veracruzana, Xalapa, Mexico and 
' Grupo de Estadistica Social, Universidad Autonoma Chapingo, 

Carretera Mexico-Texcoco Kilometro 38.5, Estado de Mexico, Mexico 
(Dated: February 1, 2016) 

Assessing quantitatively the state and dynamics of a social system is a very difficult problem. It 
is of great importance for both practical and theoretical reasons such as establishing the efficiency 
of social action programs, detecting possible community needs or allocating resources. In this paper 
we propose a new general theoretical framework for the study of social complexity, based on the 
relation of complexity and entropy in combination with evolutionary dynamics to asses the dynamics 
of the system. Imposing the second law of thermodynamics, we study the conditions under which 
cooperation emerges and demonstrate that it depends of relative importance of local and global 
fitness. As cooperation is a central concept in sustainability, this thermodynamic-informational 
approach allows new insights and means to asses it using the concept of Helmholtz free energy. 

Finally we introduce a new set of equations that consider the more general case where the social 
system change both in time and space, and relate our findings to sustainability. 
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In general, Complexity comes from the Latin plexus, 
which means interwoven, thus something complex is diffi¬ 
cult to separate because interactions determinate in part 
the future of the system [T] . 

Because interactions generate novel information, a re¬ 
ductionist scientific approach has been recognized to be 
not appropriate for studying complex systems, due to 
its attempts to simplify and separate each component in 
order to predict its behavior [T] . Considering that the in¬ 
formation generated by the interactions are not included 
in the initial and boundary conditions, the predictability 
of the system is restricted by Wolfram’s computational 
irreducibility [21 . 

Interactions can also be used by components to self- 
organize, producing global patterns from local dynamics. 
Furthermore, another major source of complexity is the 
fact that interactions themselves may change in time, 
generating non-stationary state spaces. Therefore, even 
when a solution may be calculated, it will turn inappli¬ 
cable, for the problem from which it was obtained, does 
not longer exists [T. 

Just as Lyapunov exponents characterize different dy¬ 
namical regimes, or temperature represents a statistical 
average of the kinetic energy regarding the nature of the 
system, it would be very useful to have global measures 
for complexity. The interactions between the components 
in each particular case are difficult to calculate, but com¬ 


plexity measures that represent the type of interactions 
between them, could actually be calculated. 

An useful measure of complexity should enable us to 
answer questions such as: Is a desert more or less com¬ 
plex than a tundra? What is the complexity of different 
influenza outbreaks? Which organisms are more com¬ 
plex: predators or preys; parasites or hosts; individual or 
social? What is the complexity of different music genres? 

0 

As Michaelian (2000) [4] has pointed out, one of the 
greatest misconceptions preventing the description of bi¬ 
ological or social systems from a physical perspective, 
had its origin in the concept of entropy, and the formu¬ 
lation of the second law of Thermodynamics during the 
original development of the theory of heat engines. In 
this context, entropy is a measure of the energy that is 
not available to perform work. Boltzmann later gave the 
concept of Clausius, a microscopic basis that relates the 
entropy of a system to the probability (p^ of the macro¬ 
scopic state based on the number of equivalent micro¬ 
scopic states which render the macroscopic state indis¬ 
tinguishable, defining the entropy as: 

S = -5>l°gft. (1) 

Entropy, unfortunately, became associated with disor¬ 
der, the antithesis of complexity and so how was it possi- 
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which has the same functional form of the physical en¬ 
tropy, therefore, in this work we shall talk about entropy 
(S) or information (/) as the same. Then the maximum 
entropy S max is the system total information capacity 
while the observed entropy ( S 0 bs ) is the actual infor¬ 
mation content. The macroscopical constraints are the 
macroscopical information and the historical constraints 
are the information historically excluded. 

Even more, Gershenson and coworkers 5] have pro¬ 
posed that complexity ( C ) may be directly measured as 


C = aI out ( 1 - I out ) (3) 


where a is a normalization constant and I ou t is the 
system information after all computations have occurred. 
In an entropic formulation 


FIG. 1. Modified from ’’Evolution as Entropy” [7], shows the 
relation between the total information capacity of a system, 
associated with the maximum available entropy, and the ac¬ 
tual information content of the system after all macroscopic 
constraints are applied. 


ble that biological or social systems appeared to increase 
their complexity and reduce disorder, when the second 
law demanded its destruction? One of the most accepted 
of these explanations establishes that the second law ap¬ 
plies only to closed systems, and hence it does not ap¬ 
ply directly to biological or social systems are not closed 
(they exchange energy, matter and information). Then 
these kind of systems may only reduce their entropy at 
the expense of the environment, with which form a closed 
system. 

As discussed by Brooks in his book Evolution as En¬ 
tropy, the key to resolve this apparent paradox is to re¬ 
alized that biological and social systems are nonequilib¬ 
rium phenomena characterized by an increasing phase 
space and a tendency for realized diversity to lag behind 
an entropy maximum. In a physical context two of the 
postulated mechanisms for increasing the number of mi¬ 
cro states were, the expansion of the universe, and the 
production of elementary particles [BJ. 

Lets consider the diagram in figure [T] where the vertical 
axis is a measure of the entropy of the system ( S ). If 
the maximum entropy S max grows with time, then the 
observed entropy or the final entropy that is attained 
once all constraints (macroscopical and historical) has 
been taken into account may also grow. 

Considering a more abstract definition of entropy, 
given a string of characters A', composed by a sequence of 
values or symbols x which follow a probability distribu¬ 
tion P(x ), information (according to Shannon) is defined 
as 

( 2 ) 


C=aS obs (l-S obs ) = aS{l-S). (4) 

In this form we may measure the complexity of a sys¬ 
tem by measuring its entropy. 

At this point, we present a simple computation in the 
context of game theory as applied to the social sciences 
that poses some interesting questions. Essentially we 
show that if social interactions are described by a game 
and we compute the associated entropy, then there are 
some cases in which it will increase monotonically. More 
precisely, assume for simplicity and without loss of gener¬ 
ality that individuals in a society can adopt two strategies 
A or B and let xa and xb denote the proportion of the 
population choosing strategy A and B respectively. So 
we have xa + Xb = 1- Since they are both positive, we 
can interpret them as probabilities. We assume, in the 
standard context of game theory that they satisfy the 
replicator equations 

X A if A (x A > Xb) 0) X A 

xb = (/s (xa, x b ) — </>) x B 

where the dot indicates the derivative with respect to 
time, and /a{xa,Xb) denotes the fitness level assigned 
to an individual that adopts the strategy A and similarly 
for the strategy B 1 (f> is the average fitness. Now we may 
define the entropy of the system as 

S(xa , Xb) = — [xa In xA + xb lna:^] = — a \ lnaq (6) 

and the corresponding entropy production as 

=-■£[x,b>x,] (7) 

since aq = 1 and therefore ^.J2 x i =0. Using the 
replicator equation we finally get 


I = - ^2p(x)logp(x) 
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-^ =4>)\nxi. ( 8 ) 

This is an interesting formulation because the sign of 
the entropy production depends whether the fitness of a 
particular population exceeds the average fitness of the 
entire population or not. Of course we should be careful 
about exactly which entropy we are measuring. For all 
open thermodynamic systems the entropy production has 
two terms, the internal and the external so 

dS = dS L dS 1 
dt dt dt 

All macroscopic systems and processes with an under¬ 
line physical basis, are subject to definite thermodynamic 
laws. On of the primary among these is the second law of 
thermodynamics which establishes that the internal pro¬ 
duction of entropy due to irreversible processes occurring 
within the system, must be positive, 


Let us assume that A is dominant strategy and let us 
write the entropy explicitly 

dS 

— = - [x A (/a - <P) In xa] - [x B if b - </>) lnx B ], (14) 

then as A is dominant, the population with this strat¬ 
egy has to decline over time since its fitness is lower than 
the average and eventually will disappear. Then as the 
population with strategy B is the entire population, the 
fitness of B and the average fitness are the same and the 
entropy production is zero reaching a stationary state. 
This of course means that if the game is representing a 
social process, this process will require a continuous neg¬ 
ative flow of entropy, which is not sustainable. 

Most interesting is that from the thermodynamic stand 
point 0], sustainability (understood as the capacity of a 
system to reach states of greater longevity) is attainted 
by minimizing the Helmholtz free energy 

F = U-TS 7 (15) 


dSi 

dt 


> 0 . 


( 10 ) 


and for some special cases where external constraints 
are constant, classical irreversible thermodynamic theory 
establishes that the system will eventually arrive at a 
thermodynamic stationary state in which all macroscopic 
variables, including the total entropy, are stationary in 
time, 


and therefore 



implying that 


dSj _ dS e 
dt dt 


dSe 

dt 


< 0 . 


( 11 ) 


( 12 ) 


(13) 


Maintaining such a systems in a stable thermodynamic 
stationary state requires a continuous negative flow of 
entropy into the system. 

As the (Ec[6]) is the total entropy of the game, then the 
game will evolve to a thermodynamic stationary state 
when there exists a dominant strategy. Strategic domi¬ 
nance (commonly called simple dominance) occurs when 
for one player one strategy is better than another strat¬ 
egy, no matter how his opponents may play. Many simple 
games can be solved using dominance. The opposite, in¬ 
transitivity, occurs in games where for one player one 
strategy may be better or worse than another strategy, 
depending on how his opponents may play. 


where T is the temperature of the system associated 
with the internal randomness, and U is the internal 
energy associated with the energy due to interactions. 
There are two ways of minimizing Helmholtz free energy, 
one is by minimizing U and the other is by maximizing 
S. Most of the time the internal energy U is fixed or 
cannot be controlled externally, so the only alternative is 
maximizing the entropy. As dS/dt > 0 means that the 
entropy grows and the system is in a more sustainable 
configuration. In contrast with a dS/dt < 0, means that 
the entropy decreases and the system is getting far away 
from sustainability. 

A positive entropy production is only achievable when 
the average fitness is greater that the local one and that 
corresponds to cooperative games. Cooperation is essen¬ 
tial to sustainability, as we all know, but now we have a 
quantitative indicator for measuring how sustainable is a 
system. 

Another interesting aspect of this formulation is that, 
it also makes clearer the role of entropy in complexity. 
We have showed that complexity may be indirectly mea¬ 
sured by using the system entropy, but again we must 
be very careful in not oversimplifying this with the false 
idea that complexity and entropy are exactly the same, 
they are related but they are not the same. The common 
conception of complexity, prevalent among physicists, is 
based on the notion of a noninteracting ideal gas. It is 
only in this case that a direct association with entropy 
has some legitimacy. In the real world, interactions are 
an integral part of the ordering of material particles. In 
fact, as pointed out by Michaelian (2000) 0j, a defini¬ 
tion of order had been given long ago by Helmholtz in 
his formulation of the free energy (Etjl5j. Increasing the 
entropy in Eq(T5] decreases the free energy of the system. 
In this scheme, order has a very natural description, in¬ 
creasing the order of the system makes it more stable, 
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lasting longer in time, more sustainable. This is true of 
either the ideal gas approaching equilibrium, the crys¬ 
tallization of matter, or the evolutionary dynamics of a 
community of interacting biological or social systems. 

Then, the association between information and entropy 
is tricky because complexity is measured with the infor¬ 
mation after all the computations of the system has been 
carried out. This information of course has components 
from the interactions and then the entropy that must be 
used is one that includes them, or in other words the en¬ 
tropy that appears in the Helmholtz free energy expres¬ 
sion. This allows us to make a direct connection with the 
entropy production calculated from the replicator equa¬ 
tion and identify, as Michaleian [4] suggests, sustainabil¬ 
ity with Helmholtz free energy minimization. Then the 
fitness is a measure of this minimization capacity. 

Until now, in this first approximation, we have only 
worked with the temporal dimension and not even fully 
because we have assumed that the interaction does not 
change over time. But, of course, in social systems the in¬ 
teractions may evolve with time, for example two agents 
that use to cooperate may stop suddenly (or vice versa), 
changing the form of the interaction and with them the 
entropy of the system as Axelrod proved [5]. Even more, 
the spatial dimension plays a key role in the emerging 
of cooperation [5, so, we must understand how it con¬ 
tributes to entropy. 

Lets begin by considering only the spatial contribution 
to entropy with non time dependent interactions in a 
system of n replicator equations in a space defined by a 
set of rj coordinates as 


— I S(rj,t)drj = -^2 


f d 

/ — (xilnxi)drj 


(19) 


Calculating the derivative and using the replication 
equation 


j t JS(rj,t)drj = - J | ^ (^2 Xi(rj,t2j + ^ [e.Aari + x t . (/* - </>)'_ 


( 20 ) 


using the normalization condition Xi (rj ,t) = 1 it 


turns out that (X] x i( r jit )) = 0, and then 

^ JS{rj,t)drj = - y ^ J {[cjAxi + Xi (fi - </>)] In Xijdrj. 
n n 

( 21 ) 


and finally 


JS(rj,t)drj = - ^ Je i Ax i hix i drj-'^2 J x i {fi ~ 4>) In Xjdrj. 


( 22 ) 


Now the sign of the entropy production is, in part, de¬ 
fined by the sign of (fi — (j)) in the second integral but, 
also, by the spatial term in the first. Analyzing the spa¬ 
tial integral and using the Divergence Theorem we obtain 
that 


= Xi (fi(x i,... Xi , ...x n ) - (j)). (16) 

We assume some basic probabilistic properties for this 
equations as if 0 < Xi (rj , 0) < 1 then for every subsequent 
time 0 < Xi(rj,t) < 1. In the same way if XO Xi(rj, 0) = 1 
then for every subsequent time Y^ x i( r j,t) = 1. 

Under these considerations the first approximation for 
considering a spatial contribution would be by introduc¬ 
ing a diffusive term en the replicator equations 


= eiAxi + Xi {fi - <j>) , (17) 

at 

where ei is a diffusion coefficient and A is the laplacian 
operator. 

Now a interesting question is, under which conditions 
37 /5'( r p t')d r j is bigger than zero, so the second law of 
n 

thermodynamics holds? 

Again we define the entropy as S' = — XO Xi In x,, then 


j t JS{rj,t)drj = j ^ S{rj,t)drj , 

Q Cl 


J e.;A;r,;ln Xidr 3 
n 


f f dxi 

— / VavV (lnxU dr-j+ / lna^—- -da; 

J J 9t j 

Q dCl 


< 23 ) 

where the probability flux is to the inside of the region 
fl when gp 1 > 0 and outside the region when < 

0. Considering that Vlm^ = p -Vxi then we have that 

JeiAxi In Xidrj > 0 for positive probability flux, 
n 


These result implies that if (j) > fi and the probability 
flux is positive then we recover the second law of ther¬ 
modynamics pi 1 > 0. 

Now lets consider a more general where the interaction 
may change in time and space. For this instead of the 
replicator equation, we start by using the Lopez-Padilla 
equations m- 


dxi(rj,t ) _ div [ ei ( rj ,t)Vxi(rj,t)\ (24) 

where P is the probability of finding a player in the 
position r 3 at the time t ; and eis the corresponding 
strategy that obeys the equation 


dei (rj , t) 


and using the definition of entropy 


(18) 


dt 


div [fi(rj,t)ej(rj,t)\ + V 2 [<; i>(rj,t)ei(rj,t)\ 

(25) 
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As before we want to calculate the entropy production 


j S{r j ,t)dr j Y 

f d 

/ — (xi In Xi) drj 

n 

_n 


but now we used the new set of equations 

S(rj,t)drj = — J {div [ei(rj,t)'Vxi(rj,t)\ lnxi} drj. 

fi n 

(27) 

This new expression, for the entropy productions, con¬ 
siders the complete contributions of space and interac¬ 
tions, but now an analysis for determine the conditions in 
which entropy production is monotonous is not a trivial 
one, and it will depend on the nature of the interactions 
represented by the strategies e(rj,t). 

Our main result is that complexity may be measured 
using entropy and that second law of thermodynamics is 
recovered under well defined conditions. Our results are 
very general and takes into account both interaction and 
space contributions, as well as their time dependence. 

We have showed that the emergence of cooperation is a 
consequence of entropic principles and that it may be in¬ 
duce by controlling the difference between mean fitness 
and the local. A very interesting application of this for¬ 
malism would be on education. 

As we have said, a system is complex when it comprises 
a large number of interacting subsystems or the problem 
itself changes with time, whereby it can be concluded 
that the teaching-learning process is a complex phenom¬ 
ena mHH]- On the other hand, research on control of 
complex systems indicates that managing these dynamic 
systems can not be achieved through centralized control 
schemes [15] . On the contrary, a complex adaptive sys¬ 
tem, such as education, requires to find mechanisms to 
encourage and guide the processes of self-organization 
Em Thus, a key to improve teaching may be to im¬ 
prove the process per se, but instead design better learn¬ 
ing environments (physical and virtual). In this context, 



the classes may no longer be seen as just teaching ex¬ 
ercises but as opportunities to design learning environ¬ 
ments that promote connectivity and self-organization, 
inducing the knowledge to emerge. Our results points 
that this is achievable by promoting a greater mean fit¬ 
ness value than the local one. These, somehow tell us 
that an education system based on tests is not coher¬ 
ent with a complex formulation. We should be replacing 
tests by collaborative activities where the group perfor¬ 
mance is more important that personal notes. A most 
interesting experiment, in this directions, has been car¬ 
ried out by Sugata Mitra who, since early as 1982, has 
been toying with the idea of unsupervised learning and 
computers. In 1999, he decided to carve a ’’hole in the 
wall” that separated the NIIT’s premises from the ad¬ 
joining slum in Kalkaji, New Delhi. Through this hole, 
a freely accessible computer was put up, for use. This 
computer proved to be an instant hit among the slum 
dwellers, especially the children. With no prior experi¬ 
ence, the children learned to use the computer on their 
own UZHU]. 

Finally, the complexity-based strategies help prepare 
people for an increasingly complex and intertwined 
world. Barnett and Hallarn (1999) indicate that the 
world has entered an era of ’’supercomplexity”, charac¬ 
terized by the existence of multiple frames of interpreta¬ 
tion [ 20 ] • Consequently, knowledge is uncertain, unpre¬ 
dictable, contestable and contested. Against this back¬ 
ground, universities must develop autonomy of students, 
so they can thrive and act deliberately in an uncertain 
and changing world; therefore, contemporary education 
should foster skills for: adapting to changes; understand¬ 
ing phenomena in context; making conections between 
aspects that are not clearly linked; acting against ill- 
defined situations; dealing with nonlinear behaviors, and 
in collaboration with others who may not share ideas or 
interests P3H13]. 
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